Fluctuation Relations for Quantum Markovian Dynamical Systems 
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We derive a general set of fluctuation relations for a nonequilibrium open quantum system de- 
scribed by a Lindblad master equation. In the special case of conservative Hamiltonian dynamics, 
these identities allow us to retrieve quantum versions of Jarzynski and Crooks relations. In the 
linear response regime, these fluctuation relations yield a fluctuation-dissipation theorem (FDT) 
valid for a stationary state arbitrarily far from equilibrium. For a closed system, this FDT reduces 
. to the celebrated Callen-Welton-Kubo formula. 
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Fluctuations in nonequilibrium systems have been shown to satisfy various remarquable relations [l|, Q discovered 
r-r ' during the last fifteen years. These results have led to fierce discussions concerning the nature of heat, work and 

entropy, raising the fundamental issue of understanding the interactions between a given system and its environment 
\l ■ (e.g., a thermal bath). In the classical realm, these problems have been progressively clarified while they are still under 

investigation in the quantum world. Many works on quantum fluctuation relations, including the pioneering ones, 

■ consider only closed systems prepared in a Gibbs state and isolated from their environment during their evolution 
O ' which is thus unitary [3|-|7[ . The general case of an open system continuously interacting with its surroundings can be 

formally reduced to the previous situation byconsidering the system together with its environment to be a closed global 
system: this is the approach adopted in [3l.]8l-[Iol| (see pj for a review). However, one must project out the degrees of 

i 1 „ , freedom of the bath to derive an effective dynamics for the system of interest. It is known in classical mechanics, that 
after such an elimination procedure the Hamiltonian dynamics for the global system becomes effectively a stochastic 

r/2 \ dynamics for the initial system. Similarly, in the quantum case, after integrating out the degrees of freedom of the 

■ environment and using a Markovian approximation,!! quantum master equation for the density matrix of the system 
is obtained. Under some further assumptions [ill [l2j , this master equation can be brought into a form known as 
the Lindblad equation. The Lindbladian evolution is a non-unitary dynamics for the density matrix p t of the open 
system, described by a differential equation with generator L t . This effective Markovian description is widely used in 
Quantum Optics 

In the present work, we study the time-reversal properties of an o pen qu antum system modeled by a Lindblad 
equation. A similar point of view was adopted in previous works; in |13l4l5j . the time evolution was discretized in 
an ad-hoc manner; in [IB - fl8l ] the quantum master equation was treated as an effective classical master equation and 
the concept of trajectory and the fluctuation relations for classical system were used. Our approach, here, is to work 
directly with the continuous time Lindblald equation without referring to any classical effective system, to define an 
associated time-reversed dynamics and to derive fluctuation relations with quantum observables. 
I/"") , The key results of this work are given in Eqs. (I9I12I13I15[) and represent an original contribution to quantum non- 
0^ ' equilibrium statistical mechanics. Thanks to a suitable deformation of the master equation, we prove a generic relation 
amongst correlation functions, a kind of book-keeping formula which yields the quantum analog of Jarzynski and 
£NJ ■ Crooks relations. Furthermore, by a lowest order expansion, we derive a generalized fluctuation-dissipation theorem 
valid in the vicinity of a quantum non-equilibrium steady state. For the special case of a closed system, our approach 
retrieves previously known work identities [^-|^, EH UB| as well as the quantum equilibrium fluctuation-dissipation 
; theorem [ill!!- 

The density matrix p t of the open quantum system prepared initially with poj evolves according to the master 
' equation 

d tPt = L\ Pt (1) 

■ 

where L t is the Lindbladian superoperator (i.e. a linear map in the space of operators) and L\ its adjoint with 
respect to the operator scalar product (X, Y) — Tr(X' ! Y), X and Y being arbitrary operators and X' the hermitian 
conjugate of X. Under suitable hypotheses (such as trace preserving and complete positivity [HI, [13]) the Lindbladian 
L t takes the generic form: 

L t X = i[H u X]--J2 (A?AIX + XAWt ~ 2J$XJfy . (2) 
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The first term i[H t ,X] is the conservative part, H t being the Hamiltonian of the system that may depend on time. 
The second term models the interactions with the environment (dissipation and coherence effects): the A l t 's are, in 
general, non-hermitian operators that may depend explicitly on time. In a closed system, A\ = 0. To the time- 
dependent Lindbladian L t we associate the accompanying [2l| density-matrix ir t such that i| 7Tt = 0. Physically, 
7Tt represents the stationary density-matrix in a system where time is frozen at its instantaneous value t. However, 
because 7r t depends on time, it does not satisfy Eq. (fTJ). For a closed system, we have ir t = Z^ 1 exp(—(3H t ). 
The formal solution of Eq. (fT]) can be written as pt = {P$f Po where the evolution superoperator is given by 



Pi = e5Ep- / L u du) = V / L Sl L S2 ...L Sn T\d Si . (3) 

\Js J n J s<s 1 <s 2 <...<s rl <t i=1 

For 0<ti < t2 < ... < tjv < T, the time-ordered correlation of observables Oq, 0%, 02-- -On is defined as [l2[ 

(Oi(ti)0 2 (t 2 ) . . . N (t N )) = Tr (ir P^O 1 P%O 2 . . . P^_,O n ) . (4) 



Note that P t >+1 operates on all the terms to its right and that the initial density matrix is given by po = ttq. 
A crucial element in our approach is the time-reversed system, characterized by the following Lindbladian: 

if = K-Kt X L\-K t K with t* = T-t. (5) 

The superoperator K acts on an operator X as K X = OXQ -1 [22j, 9 being the time inversion anti-unitary operator, 
with 9 2 — I, that implements time-reversal on the states ip of the Hilbert space. The superoperator K is antiunitary, 
with K 2 = 1, K = K- 1 = K\ and is multiplicative i.e. K(XY) = K(X)K(Y). Note that in Eq. ©, ir t and 
7r^~ denote left- multiplication superoperators. It is a non-trivial fact that the r.h.s of Eq. (|5|) defines a bona fide 
Lindbladian. This is ensured, for example, by imposing at each time t the quantum microreversibility condition (or 
detailed balance) (22[, which implies if = L t . Here, we do not assume detailed balance and we only require the weaker 
condition that if is a well-defined Lindbladian. Using Eq. §5§ and the relation L t l — 0, we find (if )^KTr t = and 
hence 7rf = K ir t , thus relating the accompanying distribution of the time- reversed system with that of the original 
system. 

From Eqs. ([3]) and (Q}, the evolution superoperator of the time-reversed system is P* ,fl = exp* ^ J* if duj and the 
time-ordered correlations are: 

(Oi(*i)0 2 (t 2 ) • ■ • N (t N )f = Tr (it§ ■P^ R 1 Ptl> R 2 . . . P^L^On) ■ (6) 

Given a scalar a, we deform the Lindbladian L t and if to superoperators L t (a) and if (a), that act on an 
observable X as follows: 

L t (a)X = (Lt+an^dtn^X 
and L R (a)X = (if + a(7rf )- 1 d t ir R ) X . (7) 

The corresponding evolution superoperators are Pl(a) = exp" (^f* L u (a) duj and Pp R (a) = (X* if (a) du 
Furthermore, the following conjugation identity between superoperators is satisfied: 

7r P T (a) = [tt t KP^ r {1 - a)K\ f . (8) 

This relation stems from the fact that the operator Ut — t^oPq ( a ) n ^ 1 satisfies the evolution equation dtUt — 
Ut (KL R (\ — a)K) . Equation (|5|) is the key duality relation, similar to the identity that lies at the heart of the 
proof of the classical Jarzynski identity and of the Gallavotti-Cohen theorem in Langevin and Markovian systems 
23]. Besides, all these derivations rely on a suitably modified dynamics with respect to a continuous parameter. 

Applying the fundamental identity (JSJ to two arbitrary observables A and B leads to (using the fact that K is 
multiplicative and anti-unitary) 

Tr (B\ pT(a)A) = Tr ((K A*) n R P^ R (l - a) (KB)) . (9) 

This equation, which is the essence of the quantum fluctuation theorem, expresses a generalized detailed balance 
condition. For a stationary state ir t = it (so that the a-dependence drops out) that is also reversible (i.e. Pq' R = Pg), 
Eq. ^ becomes equivalent to the detailed balance condition of 22]. 
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Equation Q can be brought into a more familiar form by introducing 

W t = -fa)- 1 ^ and W 4 R = -( 7 rf)- 1 5 i7 rf , (10) 

(in the classical limit, these operators reduce to the injected power), and by using the following relation, valid for two 
operators X and Y 



Tr (7r rF T {a) X) = (Y(0) cx^ ^-a W u du\ X{T) 



(11) 



This formula is proved by expanding Pq (a) w.r.t. the deformation parameter a (Dyson expansion), rewriting the 
trace as a correlation function via Eq. Q and finally identifying the result with the r.h.s. [23 |. Inserting the symmetry 
relation ((SJ into equation dill) , the Fluctuation Relation for an open quantum Markovian system is obtained: 

{ir B^ (O)exp- (-a ^W u du) A(T)) = (12) 
t 



Ttf (K A) (7^) - 1 ) (0) exp" (-(1 - a) / Q T du) (if B) (T) 



This identity is original, it encodes the main results of our work and will allow us to derive various relations for 
quantum systems far from equilibrium. If we interpret the mean values as classical averages and the operators as 
commuting c-numbers, then Eq. (|12p becomes Crooks' relation. In the quantum case, if we take A = B = 1 and 
a = 1, then Eq. (|12[) yields a quantum analog of the Jarzynski identity: 

^exp"f-a:^ W u duj\=l. (13) 

This quantum Jarzynski relation was first derived in [13J, but the operator-ordering issue was not accurately taken 
into account [30j . 

We now derive a Quantum Fluctuation-Dissipation Theorem for a system in the vicinity of a non-equilibrium steady 
state. Suppose that the Lindbladian is given by L t = Lq — h a (t)M a where Lq is time-independent with invariant 
density-matrix given by ttq. The time-dependent perturbations h a (t) are supposed to be small and a summation over 
the repeated index a is understood. At first order, the accompanying density-matrix 7r t , with L t ir t = 0, is given by 
TT t — tto + h a (t)e a where e a satisfies Lq e a = M\ ttq and Wt defined in ([TO]) reads Wt = —h a (t)D a with D a — 7r _1 e a . 
Using Eq. (I12[) with an arbitrary operator A, with a = 1 and £? = 1, and taking its functional derivative w.r.t. h a (u) 
with u < T, we obtain 



£(A(T)) 



Sh a (u) 



S (~ jo T du ) ^ ( T ) 



= 0. (14) 

7i=0 



Using the first order expansions derived above, we obtain 



S(A(T)) 



5h a (u) 



h=o du 



4-(D a (u)A(T)} . (15) 



We emphasize that the expectation value on the r.h.s. is taken with respect to the unperturbed density matrix ttq. By 
choosing At — Db(T), Eq. flT5"j) becomes structurally similar to the usual equilibrium fluctuation dissipation theorem. 
This generalizes to the quantum case, a recently obtained result for classical systems [24j (see [25] for an alternative 
approach) . 

In the last part of this work, we consider the special case of an isolated system. Here, the Lindbladian reduces to the 
Liouville operator: L t X = i[H tl X]. The Hamiltonian is time-dependent but the evolution of the system is unitary 
and in this framework the general relation (I12[) reduces to the recently obtained Quantum work relations 3-6]. For 
a closed system, the evolution superoperator on an observable X reduces to the unitary action Pq X — (U^) XUq , 
where the evolution operator Uq = exp (—iH u ) du. It can be shown then that the time-reversed system ([5]) is also 
closed, with Hamiltonian H^i = K H t and evolution operator Uq' R = K (Uq) [3ll ]. 
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Using identity ([SJ for a — 1 and the fact that K is multiplicative, we find that Pq (a = 1)A is equal to 

n^K ((V T <*) \(n T A)^j = n^K (u^ R K(n T A) (u^ R )^ = (16) 

n^K (l< [{U^) K (n T A) K (tff)) = ^ (U^ * T AUf. 
Substituting the last expression in Eq. © leads to 

Tr (^M) = Tr U (^) n R (iff*) ' K (B) U^ R ) . (17) 



Recalling that 7r 1 and ttt are given by the Boltzmann law, the above equation becomes in the Heisenberg represen- 
tation denoted by the superscript "H, 

Tr{B^ eMf3H?(0))exp(-f3H?(T))A n (T)) = ^Tr (k (A*) n R (u^ R f K (B) . (18) 

We emphasize that for B = 1, Eq. p7|) is a tautology (because K is anti-unitary), however it implies the non-trivial 
result (JTHJ) : this feature is characteristic of most of the derivations of the work identities. If we now take A = B = 1, 
we end up with the quantum Jarzynski relation for closed systems as first found by Kurchan and Tasaki 0, 0) : 

Tr (7r exp(^(0))exp (-pH%(T))) = . (19) 

Rewriting the l.h.s. as a time-ordered exponential and using -^H^ = (dtH t ) n we conclude as in [f| that 

Tr |V exp- (-0 jf {d s H s ) U (s) dsj j = ^ • (20) 

Considering now a system perturbed near equilibrium with H t — H—h%(t)O a , we can calculate explicitly the first order 

perturbation to the canonical density-matrix, exp(—/3H t ) = exp(—/3H) + h" Jq exp(— aH)O a exp(aH) exp(— j3H) da 

and find that D a = —/3 (O a } + exp(aH)O a exp(-aH) da. Finally, the Fluctuation-Dissipation Theorem (TT5)) 
becomes 

6(A(T)) 



5h a (u) 



= i(O a (A(T-u + il3)-A(T-u))) . (21) 

h=0 



To obtain this result, we performed the derivation w.r.t. time u on the r.h.s. of Eq. (|15l) and then used an analytic 
continuation to write the inverse temperature /3 as the imaginary part of the time, as allowed by the KMS condition 
[26| . This is the real space version of the celebrated result derived amongst others by Callen and Welton, and by 
Kubo [l^, H(| ■ For a closed system, an alternative proof that relation p^|) implies Eq. (|2"Tj) is given in [6j . 

In this work, we have derived fluctuation relations for an open quantum system described by a Lindblad dynamics 
that takes into account the interactions with the environment as well as measurement processes. We prove the 
fluctuations relations thanks to a suitable deformation of the system's dynamics: this key technical idea provides a 
truly unified picture of the fluctuations relations, whether classical or quantum, and does not require to define the 
concept of work at the quantum level. A possible extension of our work would be to study particles with non-zero spins 
such as Dirac spinors. Besides, choosing a time inversion different from that of Eq. ([5]) may lead to various families 
of fluctuation relations, as happened in the classical case [27]. Other extensions would be to derive exact solutions 
for specific models (such as quantum Brownian motions) thus providing experimentally testable predictions. Finally, 
the investigation of time-reversal properties of general non-Markovian quantum systems, in which the characteristic 
time scale of the environment cannot be neglected w.r.t. that of the system, should also yield interesting fluctuation 
relations. 

R. C. thanks K. Gawgdzki for pointing out the fact that the Lindbladian character of Eq. ([5]) is non-trivial and 
the relation with detailed balance. R. C. acknowledges the support of the Koshland center for basic research. K.M. 
thanks M. Bauer, S. Mallick and H. Orland for useful comments. Results similar to those presented here were also 
reached independently by K. Gaw§dzki and S. Attal some time ago [28[. 
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In full rigor, the integrand is f Q duW u {u) because a supplementary time dependence is introduced through the use of 
Eq. (UJ, that should appear as the argument of the time-dependent W u operator. 

Note that the Jarzynski relation does not involve the time-reversed dynamics. Thus, the proof of Eq. (|13[1 does not require 
to assume that Lfi is a Lindbladian. In particular, no quantum microreversibility condition is needed. 
For a spin-0 particle in a magnetic field, the time-inversion operation ([5j) is supplemented by the requirement that the 
reversed system evolves with vector potential At* = —A t . 



